1 link tagged with all of: metr + alignment evaluation + investigator agents
Click any tag below to further narrow down your results
Links
METR ran investigator agents through capability and alignment evals to see whether models can spot which kind they're in. Current models can, mostly by noticing the environment looks fake or that the task is a honeypot built to elicit bad behavior.
- Investigator agents have gotten better at separating alignment evals from capability evals over the past year, and Opus 5.5 ranked every alignment eval above every capability eval on their dataset.
- The tells come in two kinds: environment-level tells like obviously mocked services, and task-level tells like unethical shortcuts or high-stakes tradeoffs deliberately built in to incriminate the model.
- If models notice they're being tested, alignment evals may overstate how well a model behaves, though the authors only measured awareness, not whether it changes behavior.